Teaching LLM to Knowledge Brewing in Scrapbox
2023-10-03
nishio approach to giving AI knowledge with RAG, and how to chunk the knowledge you give it. Scrapbox is a very good possibility, though it's an open query as far as nishio 2: Incentive design is in place to create that "short enriched page" nishio 3: "Unification of expressions" will be done to link to other pages, which will increase the similarity of vector searches and make it easier to hit related concepts. it will become easier to hit related concepts With tools that don't have that functionality, shaky expressions remain shaky, and Scrapbox helps you to manually converge expressions on important concepts.
nishio The combination of these things makes the "Scrapbox + Vector Search + Generative AI" system work better than expected, especially for those who aim to verbalize things that are not yet verbalized. Especially for those whose goal is to verbalize what is not yet verbalized, the acceleration effect is better than raw ChatGPT. That's because the "similarities" presented cause us to observe what we're thinking about > from a slightly different direction.
nishio Many people may not distinguish between the two, but the process of "verbalization" includes "increasing the resolution to describe the world" and "re-describing the understanding obtained by high-resolution observation in a form that can be conveyed to others. This is different from "increasing the resolution to describe the world" and "re-describing the understanding obtained by high-resolution observation in a form that can be conveyed to others", which are two different processes. Observing what you are thinking about from a slightly different direction" increases Cognitive Resolution by thinking "[Similarity -> What is the difference? nishio What we talked about this time is that the former has a high acceleration effect. From the latter point of view, it appears to a third party that "you are piecing together an unfamiliar sentence in an unfamiliar language. That's correct, because by discarding the burden of the latter, we are developing it at a high speed. nishio I came up with a good metaphor, there is a clone of my intelligence that "uses the vocabulary I write without explanation" without explanation, and I can argue with it 24/7. This accelerates thinking, doesn't it? The "24 hours" is an advantage, but even more important is the fact that I don't have to say "This word may not be understood, so let me rephrase it..." nishio How to use Scrapbox as a knowledge brewer, some "artisans" are creating and acquiring it on their own, and how they do it is not well verbalized. How to link them (how do you link them? How to title it?) Maybe it would be more conducive to human progress if the LLMs learn this instead of trying to verbalize it?
nishio For example, in my Scrapbox, there are pages that are "Scrapbox-like" and pages that are "not Scrapbox-like", and there are "Scrapbox-like titles" and "not Scrapbox-like titles". titles that aren't". ---
This page is auto-translated from /nishio/Scrapboxでの知識醸造をLLMに教える using DeepL. If you looks something interesting but the auto-translated English is not good enough to understand it, feel free to let me know at @nishio_en. I'm very happy to spread my thought to non-Japanese readers.